Papers with linear Recurrent Neural Networks
VisualRWKV: Exploring Recurrent Neural Networks for Visual Language Models (2025.coling-main)
Copied to clipboard
| Challenge: | Visual Language Models (VLMs) have been gaining popularity with large language models, but few attempts have been made to incorporate efficient linear Recurrent Neural Networks (RNNs) into VLMs. |
| Approach: | They propose a linear RNN model with a data-dependent recurrence and sandwich prompts to enhance modeling capabilities and a 2D image scanning mechanism to enrich the processing of visual sequences. |
| Outcome: | The proposed model achieves competitive performance compared to Transformer-based models on various benchmarks. |